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Abstract — We consider the problem of transmitting a bivariate 
Gaussian source over a two-user additive Gaussian multiple- 
access channel with feedback. Each of the transmitters observes 
one of the source components and tries to describe it to the 
common receiver. We are interested in the minimal mean squared 
error at which the receiver can reconstruct each of the source 
components. 

In the "symmetric case" we show that, below a certain signal- 
to-noise ratio threshold which is determined by the source 
correlation, feedback is useless and the minimal distortion is 
achieved by uncoded transmission. For the general case we give 
necessary conditions for the achievability of a distortion pairfl 

I. Introduction 

We consider the problem of transmitting a memoryless 
bivariate Gaussian source over a two-user additive white 
Gaussian multiple-access channel with perfect causal feedback 
from the channel output to both transmitters. Each of the 
transmitters observes, besides the previous channel outputs, 
one of the source components which it tries to describe to 
the receiver subject to an average power constraint on its 
transmitted signal. Based on the channel output, the receiver 
estimates the two source components. The quality of the esti- 
mate is measured in squared-error distortion on each individual 
component. We seek the achievable distortion pairs. 

We show that in the "symmetric case" — where the trans- 
mitters are subjected to the same average power constraint 
and the ratio of the distortions to be achieved is equal to 
the ratio of the corresponding source variances — there is 
a threshold signal-to-noise ratio (SNR), determined by the 
correlation between the source components, below which 
feedback is useless and the minimal distortion is achieved by 
uncoded transmission. This result strengthens a previous result 
of Lapidoth and Tinguely [1] for the same problem but without 
feedback. For the general case we give necessary conditions 
for the achievability of a distortion pair. 

Related results by Oohama [2] and Wagner et al. [3] only 
treated the source coding aspect of this problem by solving the 
Slepian-Wolf lossy version for the bivariate Gaussian source 
and by Ozarow [4] who only treated the channel coding 
aspect by computing the capacity region of the Gaussian 
multiple-access channel with feedback. We shall, however, 
not rely on these source coding and channel coding results 
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since the separation theorem does not apply to our problem. 
That feedback is useless in the symmetric case below some 
threshold SNR is all the more surprising in view of the recent 
work of Lapidoth and Wigger [5] who showed that feedback, 
even if noisy, always increases the capacity region of the 
Gaussian multiple-access channel. 

II. Problem Statement 

We consider a discrete-time two-user additive white Gaus- 
sian multiple-access channel with perfect and causal feed- 
back from the channel output to both transmitters. The two 
transmitters of the multiple-access channel each observe one 
component of a memoryless bivariate Gaussian source and try 
to communicate it to the receiver. 

The time-fc output of the Gaussian multiple-access channel 
is given by 

Y k = zi.fc + x 2: k + Z k , (1) 

where x\.k € K and x 2 ,k G K are the symbols sent by the 
two transmitters, and Zk is the time-fc additive noise term. 
The terms {Zk} are independent identically distributed (IID) 
zero-mean variance-TV Gaussian random variables that are 
independent of the source sequence. 

The source symbols produced at time k are (£1.,^, Safe) 
where the {(S\ t k, S2,k)} ar e IID zero-mean Gaussians of 
covariance 
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with p E [—1,1], and < of < oo, i = 1, 2. The sequence of 
the first source component {Si,k} is observed by Transmitter 1 
and the sequence of the second source component {S2,k} is 
observed by Transmitter 2. Based on their source sequence and 
the feedback observed up to time fc, the transmitters produce 
their respective time-fc channel inputs 

where 



i = l,2, 



we have used the shorthand notation Si 
. . , & n ) and Y^ 1 = (Y 1} ..., F fe _i), and where 



f(") . 



X 



1,2, fc=l,. 



, n. 



(3) 



The transmitted sequences of the two encoders are average- 
power limited to Pi and P 2 respectively, i.e. 



1 71 r 



<Pi, £ = 1,2. 



(4) 



The decoder estimates the two source sequences based on the 
channel output Y = (Y±, . . .Y n ). These estimates are denoted 



by Si 



4 W 



(Y) and S 2 



(j) 2 n \Y) respectively, where 
> E™ , i = 1,2. 



(5) 



We are interested in the minimal expected squared-error distor- 
tions at which the receiver can reconstruct each of the source 
sequences. 

Definition 1: Given 0\,o 2 > 0, p G [-1,1], Pi,P 2 > 0, 
and N > we say that the tuple (Dx, D 2 , erf, of, p. Pi,P 2 ,N) 
is achievable if there exists a sequence of encoding functions 
(fik'f2k) as m ® an d a sequence of reconstruction pairs 



) as in (O satisfying the average power constraints 



© and resulting in average distortions that fulfill 
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T7 ^ ' 



lim 



whenever 



k=l 



Y k =&l{S u Y 



S. 



s, 



< Di 



- 1 ) + f^(S 2 ,Y k - 



i = 1,2, 



l ) + z k , 



for fc = 1, ...n, and {(Si^, S 2j /c)} are IID zero-mean bi- 
variate Gaussian vectors of covariance matrix Ksg as in (ffj 
and {Zk} are IID zero-mean variance- N random variables that 
are independent of {(Si^, S 2 ,fc)}. 

The problem we address here is, for given a 2 , a 2 , p, 
N, Pi, P 2 , to find the set of pairs (Di,D 2 ) such that 
{D\, D 2 , a 2 , a\ 1 p, P l ,P 2 ,N) is achievable. 

Remark: As in [1, Section III] it can be shown that there 
is no loss in generality in assuming that the two source 
components are of equal variance and that the correlation 
coefficient is non-negative. Hence, for the remainder we shall 
assume 



P e [0. 1] 



and 



Furthermore, the convexity argument of [1, Section III] ap- 
plies also to the case with feedback so that for any given 
a 2 , p, and N, the set of all (Di, D 2 , Pi, P 2 ) such that 
(.Di, D 2 , a 2 ,(T 2 , p, Pi,P 2 , N) is achievable is a convex set. 

Of special interest is the "symmetric case" of this problem 
where both transmitters are subject to equal power constraints, 
and where we seek to achieve the same distortion on each 
source component. That is, for some given N and P\= P 2 = 
P we are interested in 

D*{a 2 ,p,P,N) = inf{max{L>i,L> 2 } : 

(Di, D 2 , cr 2 , cr 2 , p, P, P, N) is achievable}. 

III. Main Results 

We now present necessary conditions for the achievability of 
(Di, D 2 , a 2 , a 2 , p, Pi,P 2 , N) and show that in the symmetric 
case if P/N < p/(l — p 2 ) then the minimal distortion 
D*(a 2 ,p,P,N) is achieved by uncoded transmission and 
feedback is useless. The corresponding proofs will be dis- 
cussed in Section llVl 

Denote by Rs 1 ,s 2 (-^l, D 2 ) the rate-distortion function for 
the pair (Si, S 2 ) when this pair is observed by one common 



encoder. For (Si, S 2 ) jointly Gaussian as in (01 and with a 2 = 
a 2 = a 2 , we have 



R Sl ,s 2 (Di,D 2 ) 

2 l0 &2 y DlD2 J 
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(6) 



where the regions 3> a , S'b and 2# c are given by 
®a = \d 1 < <J 2 (l - p 2 ), D 2 < (a 2 (l - p 2 ) - D 1 



a 2 -D 1 



= < < Di < a 2 



(a 2 (l-p 2 )-Pi) 



a — D\ 



<D 2 <a 2 {\- p 2 )+ p 2 D, 



9>c = {0<L>i <<t 2 ,D 2 ><t 2 (1- p 2 ) + p 2 D 1 ) . 

The expression for Rs lt s 2 (Dii D 2 ) has been derived in [8] 
and [1] by different approaches. 

Further, denote by i?s 1 |s 2 (-Di) the rate-distortion function 
for Si, when S 2 is known to both, the encoder and the decoder, 
and analogously by Rg 2 1 g x {D 2 ) the rate-distortion function for 
S 2 , when Si is known to both, the encoder and the decoder. 
For (Si, S 2 ) jointly Gaussian as in (O and with o\= o\ = cr 2 , 
we have 



Rs 2 \ Sl (D 2 ) = - log 2 f 1 D J 1 



(7) 



(8) 



Theorem 1: A necessary condition for the achievability of 

(D 1 ,D 2 ,a 2 ,(j 2 , p,P 1 ,P 2 ,N) is that there exists ape [0,1] 
such that 



Rs 1 ,s 2 {D 1 ,D 2 ) < -log 2 I 1 + — ) (9) 



Rs 2 \ Sl (D2) < 2 log 2 f 1 + N 



(10) 



(11) 



where the explicit forms of the rate-distortion functions on the 
LHS, are given in ©, ©, and (HJ respectively. 
In the symmetric case, (0 & © yield 



D > 



1 ( Na 2 (l+p) o h s\ 

2 {n+2P(1+p) + a V 1 - P)) 



if £< 



2 / Njl-p*) 
N+2P(l+p) 



(12) 



if 



N ^ 1-p 2 



and ([TOll & (or GJJ & ®) yield 

7V(l-p 2 ) 



Then 



D > a l - 



(13) 

N + P(l-p 2 ) K ' 

We denote the RHS of O by £(<7 2 , P, 7>, A 7 ", /5) and the RHS 
of (HI by if>(a 2 ,p,P,N,p). 

Corollary 1: In the symmetric case 

D*(a 2 ,p,P,N) > 

o min i max {£(ct 2 , p, P, AT, p), ipia 2 , p, P, AT, p)} . 

Note: For P/iV < p 2 /(2(l - p)(l + 2p)) the minimum in 
Corollary [TJ is achieved by p = 1, and for all larger P/N the 
minimum is achieved by the p* for which 

Z{a 2 ,p,P,N,p*)=^{cr 2 ,P,P,N,p*)- 

We can now verify that for P/N = p/(l — p 2 ) the lower 
bound on D* (a 2 , p, P, N) from Corollary [JJ is achieved by 
uncoded transmission. For P/N = p/(l — p 2 ) the minimizing 
p is p* = p leading to the bound 

D*(o 3 ,p,P,N)>o 3 (l-p). (14) 

To see that this is achievable by uncoded transmission, note 
that in the symmetric case, uncoded transmission of the form 
%i,k = \/P/o~ 2 Si,k, i = 1, 2 results in the distortion 

,P(l-p 2 )+N 



N 



(15) 



2P(l + p) 

(see [1, Corollary 2]), which, when evaluated at P/N = 
p/(l - p 2 ) yields the RHS of ([14). The following theorem 
extends this result to all P/N < p/(l - p 2 ). 

Theorem 2: In the symmetric case if P/N < p/(l — p 2 ) 
we have 

p 2 ) + N 



D*(a 2 ,p,P,N)=a 2P{1 



N 



(16) 



2P(l + p) 

i.e. the minimal distortion is achieved by uncoded transmis- 
sion, and the availability of feedback is useless. 

IV. Sketches of Proofs 

We shall discuss the proofs of both theorems but with more 
particularity on the proof of Theorem [2] We do so, because 
the basic techniques to the proof of Theorem [TJ are the same 
as in [4] and [6, page 15]. 

A. Proof of Theorem Q] 

To prove Theorem [TJ we shall use the following lemma 
Lemma 1: Let the sequences {Xi t k} and {X2,k} satisfy 
£r=i E[x? fc ] < nPt, i = 1,2. Let Y k = X hk + X 2 . k + 
Z k , where {Z k } are IID zero-mean variance-A^ Gaussian, and 
where for every k, Z k is independent of (Xi t k, ^2,fc)- Let 
p G [0, 1] be given by 

^ELi E[Xi ife X 2 , fc ]| 



P = 



(^Sfe=iE X 2 k j 2~2k=i 



(17) 



x ik 



fe=i 



I(X ljk , X 2 . k ; Yk) < ~z log 2 1 + 



N 



(18) 

^I(X l!k ;Y k \X 2 , k ) < ^log 2 ( 1 + Pli \~ T ~ p2) ) , (19) 



fe=i 



N 



, x « / P 2 (l-P 2 ) 



fe=i 



(20) 



The proof of Lemma [TJ follows from the proof of the main 
result in [4] and is omitted. Theorem [TJ can now be proved by 
showing 



nR SuS2 (Di,D 2 ) </(S 1; S 2 ;Y) 

I(Si,Sa;Y)<£l(X 1 , fc ,X 2)fc ;Y /b ), 



nfls 1 |s,Pi)</(S 1 ;Y|S 2 ) 
I(Si;Y|S 2 )<5^/(X ljfc ;n|X 



fc=l 



nP S2 , Sl (^ 2 ) <7(S 2 ;Y|S 1 ) 

7(S 2 ;Y|S 1 )<^7(X 2)fc ;Y fe |X 1 , fc ) ) 
fe=i 



(21) 
(22) 

(23) 
(24) 

(25) 
(26) 



and by then jointly bounding the expressions on the RHS of 
d22l ). ( 1241 ). and d26l ) by means of Lemma [TJ The proofs of 
( f2Tb - d26l i follow along the same lines as the proof of the 
univariate analog of which the derivations can be found in 
[6, page 15] (also coarsely stated in [7, equation (8)]). The 
main ingredients in those derivations are the convexity of the 
rate-distortion functions and the data-processing inequality. □ 

B. Proof of Theorem [2] 

To prove the theorem we need to show that D* > D u 
whenever P/N < p/(l — p 2 ), where D* is short for 
D*(a 2 ,p, P, N). Since the optimal reconstruction is the condi- 
tional expectation, it suffices that we show that a contradiction 
arises from the assumption: 

Assumption 1 (Leading to a contradiction): The encoding 
rules {/.' satisfy the average power constraints (HJi for some 
P\= P 2 = P satisfying P/N < p/(l — p 2 ) and, when com- 
bined with the optimal conditional expectation reconstructors, 
achieve 73*, where D* < D u 

To show that this assumption leads to a contradiction, let 
{Xi fc,X 2 .fe} and {Y k } be the resulting channel inputs and 
channel outputs when {/.v} are used to describe the source. 
Let further Si = E[Si|Y] and S 2 = E[S 2 |Y]. 

We focus on the estimation that Transmitter 2 can make 
for the vector W = Si — pS 2 using his knowledged of S 2 
and (through the feedback link) Y. This vector is the part 
of (Si,S 2 ) which is independent of S 2 and hence initially 
completely unknown to Transmitter 2. However, from the 



feedback link Transmitter 2 can retrieve information about W. 
The contradiction we shall obtain will be on the distortion on 
W that can be achieved at Transmitter 2. Under AssumptionQ] 
we shall derive contradictory lower and upper bounds on the 
achievable value for this distortion. 
For any estimator tpW (S2, Y) we set 



h a 



1 



|W-¥> (n) (S 2 ,Y)|| 



where ||v|| 2 = £Li w fe- 

1 ) "Lower Bound" on Dwi^^)-' In this subsection we 
show that 



Assumption Q] =>• 

D w (<pW) > <j 2 (1 



N 



N + P(l- p 2 



V(/7 



(n) 



(27) 



The main ingredient is the following lemma: 
Lemma 2: 



Assumption Q] 



J(S i; Y|S 2 )<|log 2 (l + ^V 



The proof of Lemma [2] will be discussed in Section IIV-CI 
Inequality ( l27b will follow from Lemma [2] if 



D w {^ n) )>° 2 (l-P 2 )'2-^ I(S ^^ ) . 



(28) 



To this end we denote by Rw (D) the rate-distortion function 
for a source of the law of W. We then have 

nR w (D w (^)) < J(W;^")(S 2 ,Y)) 

</(W;Y,S 2 ) 

= /(Si-pS 2 ;Y,S 2 ) 

= / l (S 1 - /9 S 2 )-/i(Si-pS 2 |Y,S 2 ) 

^ ft(Si - pS 2 |S 2 ) - ft(Si - pS 2 |Y, S 2 ) 

= MSi|S 2 )-/i(Si|Y,S 2 ) 

= /(Si;Y|S 2 ), (29) 

where inequality a) follows by the data-processing inequality 
and the convexity of Rw{-)- Inequality b) follows by the data- 
processing inequality, and c) follows since S 2 and Si — pS 2 
are independent. 

Replacing R w (D w {f {n) )) in 



log 2 



^ 2 (1-P 2 ) 
D w {v {n) ) 



by its explicit form gives 
</(Si;Y|S 2 ). 

, which combines with 



Rewriting this inequality gives 
Lemma [2] to prove d27l i. 

2) "Upper Bound" on minimal Dwi,^"^): We show that 
Assumption Q] implies that the estimator 

^)(S 2 ,Y) = a-S 1 -/3-S 2 

= aE[S 1 |Y]-/?S 2) 



a = (1 - P)- 



and 



/?=(1-P)- 



- D* 



(30) 



D* D* 
violates ( 1271 ). To prove this we use the following two lemmas: 

Lemma 3: For any scheme achieving D* and any 6 > 
there exists an uq (6) such that for all n > no (6) the following 
three inequalities are satisfied 



1 n 

— y e Si,kSi,, 

i— 1 

z— 1 

1 " 

— y E Si.kSz,, 



> a 2 - D* - 6, 
< cr 2 - D* + 6, 
<a 2 -D* + 26. 



Lemma 4: For all P/N < p/(l — p 2 ) we have 
a{p- P) > 0. 



(31) 
(32) 
(33) 

(34) 



The proofs of Lemma [3] and Lemma [4] will be discussed in 
Section IIV-CI We now derive the desired upper bound on 

A^ (n) ) = -E[||W-^(S 2 ,Y)|| 2 ] 

n 

1 n 

= - E (Si >k - pS 2 .k - olSi^ + f3S 2 ,k) 
n L 

k=l 
1 n 

= - V E \(S hk - aS hk - (p - /3)S 2 , fc ) 2 



k=l 



1 



SikS 



l.k 



k=l 



c-2 
J l,fc 



-2(p-/?)E[S ljfe S 2 , fe ]+a 2 E 

+ 2a(p - p)E [s lt kS 2 ,k 

+ (p~l3) 2 E[Si k ]) 
< cr 2 - 2a(cr 2 — D* — 5) — 2(p - (5)pa 2 

+ a 2 ((T 2 -D* + 6) + 2a{p - [3){a 2 - D* + 25) 
+ (p-/3)V (35) 

where the last step follows from Lemma [3j using the fact that 
a > 0, and using Lemma [4] 

Upon letting n tend to infinity, we obtain 

lim D w (ip^) < a 2 - 2a(a 2 - D* - 8) - 2(p - f3)pcr 2 

+ a 2 (a 2 -D* + 6) 

+ 2a{p - !3){o 2 ~D* + 26) + (p - /3)V. 
But since 6 > was arbitrary, 

lim Dw(v> (n) ) <<J 2 - 2a(a 2 - D*) - 2(p - j3)pa 2 

n—>oc 

+ a 2 (a 2 - D*) + 2a{p - (3){a 2 - D*) 
+ (P-/?)V 



<^(l-p) 2-— (1-p) 



b) 



D* 



N + 2P{l + p) 
N + P(l -p 2 ) 
AT 



(1-P) 



'iV + 2P(l- i o 2 )' 

which contradicts d27l ). Here, a) follows from d30l ), and b) since 
we assumed D* < D u . □ 

C. Proofs of Lemmas 

To prove Lemma [2] we first notice that the assumption 
P/N < p/(l - p 2 ) implies, by © & (BJ, that 

R Sl ,s 2 (D a ,D u ) = ilog 2 (l+ 2P( ^ +P) 



Hence, 

??■ 



log 2 1 



2P(1 + P) 
N 



= nR Sl ,s 2 (D u ,D u ) 

<nR SuS2 (D*,D*) 

b) " 

<J2 I (Xi,k,X 2 , k ;Y k ) 
fe=i 

c ) n , / 2P(1 + pi 
< - log 9 1 + — v " 

2 \ AT 

(36) 

where p is given in ( fTTI l. Here a) follows from the assumption 
D* < D u and the strict monotonicity of Rs 1 .s 2 (D, D); b) 
follows from (f2Tb & d22b ; and c) follows from Lemma Q] 
From d36b and ( TTTb we conclude that 



Y 2 
A 2,fc 



The lemma now follows from d24l) . Lemma Q] inequality (fl9l l. 
and (EH). □ 
We turn to Lemma [3] and begin by proving Inequalities (|3"0 
and d32b . By the definition of achievability, for any scheme 
achieving D* and any 5 > there must exist an uq(5) such 
that for all n > no(S) 



1 

D *-*<-E E F 

fc=i 



< D* 



1,2. 



(38) 



Since, by our assumption that Si = E[Si|Y], the orthogonal- 
ity principle must be satisfied, we obtain from (l38l that 

1 n 

a 2 - D* - 8 < -Y^E \s l<k Si, k ] <a 2 -D*+6, (39) 



n 

/c=i 
fc=i 



< a — D* 



(40) 



To prove the inequality d33l we start by observing that any 
scheme achieving D* must satisfy 



This follows by a time-sharing argument: assume there would 
exist a scheme achieving D* with D\ = D* and D 2 = 
D < D*. Then, by symmetry there would also exist a scheme 
achieving D* with Di — D < D* and D 2 = D*. Time- 
sharing between those two schemes would give a scheme 
achieving 1/2(D* + D) < D* which contradicts the definition 
of D*. 

Statement (|4TT > implies, in view of d38l . that for any scheme 
achieving D* and any 5 > there must exist an no (5) such 
that for all n > n (S) 



~>2.k 



Sl,k) 



k=l 

which is equivalent to 

1 n 

— / E S 2 .kSi k 
n ' L 



> - V e Us^ - s hk f 

n ■* — ' L 



n 

fc=i 
Applying 



< 



fc=i 

to the RHS of 



1 ™ 

i E E K 



+ <5. 



2<5, 



(42) 



gives 



1 ™ 



< CT 2 



25. 



fe=i 



□ 

To prove Lemma 0] we notice that a is always positive. 
Hence, the proof of Lemma |4] merely requires showing (3 < p 
whenever P/N < p/(l — p 2 ). Furthermore, since D* is 
certainly non-increasing in P/N, and therefore (3 is non- 
decreasing in P/N, it is sufficient to show that [3 < p for 
P/N = p/(l — p 2 ). And this follows from plugging the lower 
bound ( fT~4-b for D* in the expression for (3. □ 
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